Blog

Posts

TitleDate publishedFeaturedStatusTagsTop postWritten bymeta:authormeta:descriptionmeta:imagemeta:title
Optimising Performance of Spark's Postgres Database
PublishedEngineeringSpark
Miroslav BajtošMiroslav BajtošSetting up observability for Postgres performance requires a bit of work, but it gives you valuable insights into the performance of your database.station-server.svgOptimising Performance of Spark's Postgres Database
How we reduced memory usage by 90%
PublishedEngineeringSpark
Miroslav BajtošMiroslav BajtošFour easy changes reduced the total memory usage of Spark’s Node.js backend from 4+ GB to ~360 MB: Convert plain data objects to class instances. De-duplicate immutable string values. Carefully choose how you calculate percentiles. Represent timestamps as numbers.nasa_reduced_gravity_walking_simulator.jpgHow we reduced memory usage by 90%
How SPARK Samples Filecoin Deals
PublishedEngineeringSpark
Miroslav BajtošMiroslav BajtošSPARK is checking whether public content stored on Filecoin can be retrieved. This post explains how SPARK samples Filecoin deals to find content that is expected to be publicly retrievable.nasa-Ed2AELHKYBw-unsplash.jpgHow SPARK Samples Filecoin Deals
How SPARK Discovers Content Stored in FIL+ Deals
PublishedEngineeringSpark
Miroslav BajtošMiroslav BajtošSPARK is checking whether public content stored on Filecoin can be retrieved. This post explains how SPARK Spark discovers the CIDs (content identifiers) of the data stored in Filecoin deals.spacex-VBNb52J8Trk-unsplash.jpgHow Spark Discovers Content Stored in FIL+ Deals
Spark Roadmap H2 2024
PublishedEngineeringSpark
Patrick WoodheadPatrick WoodheadThe roadmap for the Spark Protocol in H2 2024nasa_space_shuttle_challenger.jpgSpark Roadmap H2 2024
How SPARK Retrieves Content From Filecoin
PublishedEngineeringSpark
Miroslav BajtošMiroslav BajtošIn the previous posts, we explained how SPARK samples Filecoin deals and how SPARK discovers content stored in those deals. In the final post of this series, we will explain how SPARK tests whether the content can be retrieved.nasa-mars-rover-perseverance.webpHow SPARK Retrieves From Filecoin
Spark sees 10x improvement in Filecoin retrievability
PublishedProductSpark
Patrick WoodheadPatrick WoodheadOn April 18th 2024, the overall Filecoin retrieval success rate (RSR), as measured by Spark, was 1.22%. Many Storage Providers were simply not serving retrievals. On the 25th September 2024, Spark measured the overall Filecoin RSR at 12.8%, a 10.5x improvement.nasa_multi-axis_gimbal_rig.jpgSpark sees 10x improvement in Filecoin retrievability
Filecoin Spark: Common Critiques
PublishedEngineeringSpark
Patrick WoodheadPatrick WoodheadA Review of Current Common Critiques of Filecoin Sparknasa_new_york_city_grid.jpgFilecoin Spark: Common Critiques